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Abstract 

We study the problem of allocating limited feedback resources across multiple users in an orthogonal- 
frequency-division-multiple-access downlink system with slow frequency-domain scheduling. Many 
flavors of slow frequency-domain scheduling (e.g., persistent scheduling, semi-persistent scheduling), 
that adapt user-sub-band assignments on a slower time-scale, are being considered in standards such 
as 3GPP Long-Term Evolution. In this paper, we develop a feedback allocation algorithm that operates 
in conjunction with any arbitrary slow frequency-domain scheduler with the goal of improving the 
throughput of the system. Given a user-sub-band assignment chosen by the scheduler, the feedback 
allocation algorithm involves solving a weighted sum-rate maximization at each (slow) scheduling 
instant. We first develop an optimal dynamic -programming-based algorithm to solve the feedback 
allocation problem with pseudo-polynomial complexity in the number of users and in the total feedback 
bit budget. We then propose two approximation algorithms with complexity further reduced, for scenarios 
where the problem exhibits additional structure. 
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Index Terms 
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I. Introduction 

Orthogonal-frequency-division-multiple-access (OFDMA) is the multiple-access technology of 
choice for many current and future wireless standards such as 3GPP Long-Term Evolution (LTE), 
IEEE 802. 16e (WiMAX) and Long-Term Evolution Advanced (LTE- A). With the singular goal of 
achieving higher throughputs in order to keep pace with the ever-growing suite of data-hungry 
applications, OFDMA systems typically operate in conjunction with a fast frequency-domain 
scheduler that allows for aggressive adaptation to the fading conditions of the channel. Here, 
user-sub-band assignments are typically made once every 1ms, 2ms or 5ms depending upon 
the standard under consideration. In the quest for higher data rates, the overhead incurred in 
enabling such fast frequency-domain scheduling is often ignored. 

Primarily, there are two types of overhead that facilitate user scheduling in an OFDMA down- 
link system. These are: the overhead incurred in (i) communicating user-sub-band assignments 
and in ( ii) collecting channel state information (CSI) from all users commonly referred to as the 
process of feedback. To address the first issue, recently, there has been an increasing interest 
in "slow" frequency-domain scheduling flTJ — [[5]| instead of its faster counterpart for applications 
where the overhead demands of the latter do not justify its use. For example, LTE adopts (semi- 
)persistent scheduling for voice-over-IP applications that typically do not have high throughput 
demands [Q]|-fl4]|. Here, user-sub-band assignments are decided on a slower time-scale while 
link adaptation (on the fast time-scale) specifically in the semi-persistent approach, is achieved 
through Hybrid Automatic Repeat Request (HARQ) re-transmissions. Li et al. [51 show that 
slow OFDMA scheduling can achieve throughputs close to the ideal case in many real-world 
scenarios. 

Moving on to the implications of ( ii), we borrow an example of a typical LTE setting recently 
provided in Ouyang et al. 11231 : In LTE, the smallest unit of bandwidth that can be assigned to a 
user for data transmission is called a resource block, which is essentially a group of OFDM sub- 
carriers. If we consider a 10MHz LTE system with L = 50 resource blocks shared by K = 50 
users equipped with standard 4-bit codebooks (modulation/coding tables) at the mobiles, we have 



3 



a total feedback bandwidth of AKL = 4 x 50 x 50 = lOkb per sub-frame (61. Given a typical 
uplink data rate of 48kb per sub-frame, this consumes 20% of the uplink capacity, clearly making 
feedback bandwidth consumption an important bottleneck. This observation, amongst others, has 
motivated the development of limited feedback techniques lT7l- lfT5l . In general, adapting the size 
of the codebook (e.g., CSI table at the mobiles) lf8l- lfi~0l and sub-carrier grouping [TTTTl — [fT5ll . 
subject to a constraint on the total available feedback bandwidth, are two of the most popular 
multi-user limited feedback approaches in the literature. In the former, the size of the codebook 
on each OFDMA sub-band, and potentially the codebooks themselves, are periodically chosen 
based on the "state" of the network. In the latter, feedback reduction is achieved through a 
grouping technique where one CSI report is generated for a group of OFDMA sub-bands. 

In this paper, we propose a feedback allocation policy that operates in conjunction with a 
slow frequency-domain scheduler assumed given. In particular, given a scheduling assignment 
on a slower time-scale, i.e., once every T time slots, the feedback allocation policy decides user 
codebook sizes again on the same time-scale. Thus, in the context of past literature, we focus 
on the former limited feedback approach of choosing dynamic codebook sizes as a function 
of the network state (e.g., channels, queues, etc.), a process that we call feedback allocation 
henceforth^, to address the second type of overhead. The difference between our approach and 
past work on dynamic codebook selection is that our algorithm adapts to queue sizes and hence 
user applications, in addition to the channel state thereby generalizing earlier methods. 

The main contributions of this paper are the following: 

1) We propose a throughput-optimal feedback allocation policy that overlays a given slow 
scheduler. The proposed policy takes the form of a weighted sum-rate maximization 
problem that needs to be solved once every T time slots. Throughput-optimality is with 
respect to the space of all possible feedback allocation policies while fixing the particular 
data scheduler of interest. 
Efficient algorithmic implementability of these policies is a critical design requirement, and 
this is the focus of our remaining contributions. Our focus is aligned with several papers over 
the last decade, which study the algorithmic aspects of queue-based scheduling for specific 

'One can in general consider a more comprehensive feedback allocation policy that includes both codebook-size adaptation 
and sub-carrier grouping. However, such policies are beyond the scope of this paper and a subject for future study. 
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network structures and resource allocation problems (see, e.g., Il24ll - [|28|| and references therein). 
Needless to say, the difficulty in solving the weighted sum-rate maximization problem in each 
slot is intricately tied to the resource being optimized. Recently, significant strides were made by 
Tan et al. [|27ll , ||28l in solving the joint queue-based scheduling and power control problem that 
has attracted much interest over the years (see ll2~6ll and references therein). Here, the possible 
transmission rates in each slot come from a continuous region induced by all possible power 
allocations. The authors ll27ll . 11281 solve non-convex power-control problems (e.g., weighted 
sum-rate) accurately and efficiently by using solutions to related convex problems (e.g., max- 
min rate) in an intelligent manner. Optimality is established under many channel settings. While 
the lack of convexity is due to interfering users in ll27ll . 11281 . in the model by Huang et al. 
G6l . self-noise due to channel estimation error forms the cause. The authors [26] nevertheless 
propose both optimal and sub-optimal approaches with varying degrees of complexity. In contrast 
to power allocation, in our case, the region of possible rates in each slot is discrete and is induced 
by all possible splits of the total feedback budget. This allows us to leverage many powerful 
tools from the area of combinatorial optimization. With the exception of the work of Ouyang 
and Ying ll23l . the problem of feedback allocations has not been considered in the past, to the 
best of our knowledge. 

2) We develop a dynamic programming algorithm that solves the weighted sum-rate feedback 
allocation problem with pseudo-polynomial complexity in the number of users and the total 
feedback bit budget. This approach is exact and requires no assumptions on the structure 
of the weighted sum-rate function. 

3) We show that in many practical wireless systems, the weighted sum-rate is non-decreasing 
and sub-modular in the feedback budget. Using this observation, we leverage sub-modular 
optimization results from combinatorial optimization (e.g. lfT9l - ll2TI ) and propose a reduced- 
complexity algorithm with an approximation guarantee of (1 — -). 

4) Multiple-input- single-output (MISO) beamforming is being considered as a potential trans- 
mission mode in the Long Term Evolution standard [TJ. For such systems, we show that 
when the popular Random Vector Quantization codebook ifTTl . 11331 . 041 is used, we are 
able to reduce the complexity even further and provide an approximation guarantee of |. 

The rest of this paper is organized as follows. In Section [III we introduce the system model 
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for feedback allocation and slow data scheduling. In Section Unl we discuss the notion of 
throughput-optimality in queueing networks and introduce a throughput-optimal joint feedback 
allocation and slow data scheduling policy. In Section [IV] we solve the optimal online feedback 
optimization problem for both objectives while in Section |Vj we investigate methods of reducing 
the complexity of the optimal online optimization problem by exploiting more structure in the 
objective function. Simulation results are presented in Section |VIl Concluding remarks are made 
in Section mil 

Notation: Xij denotes element of matrix X while denotes element i of vector x. Given 
matrices X, Y G R px<? , X < Y means x 4j < y y ,Vi = 1, . . . ,p, j = 1, . . . , q. R+, N and N 
represent the non-negative real numbers, non-negative integers and positive integers respectively. 

II. System model 

We consider the downlink of a frequency-division-duplex OFDMA system with L sub-carriers/sub- 
bands and K users that operates in slotted-time. The network model is described below: 

Channel State: The true supportable rate for user i on sub-band j at time t is given by 
A%'M- We assume that fJ>ij[t] is ergodic and comes from a finite but potentially large set Ai. 
We assume that the mobile has perfect knowledge of the channel state {/%[£] jj^i m every 
time slot. The cumulative distribution function for rate fj,^ [t] is given by Pr (/x^ [t] = m) = 
T^mi ipLi [t]) , m E M, where cti [t] denotes a large-scale fading gain that is dependent on user 
position and comes from a finite set ati[t] E fi. Users change positions once every T slots 
where T6 {1,2,3,...} denotes the large-scale fading coherence time. For ease of notation, we 
introduce a counter i = [^\T to keep track of the slower large-scale fading time-scale, i.e., 
TTmi = n rni (<*i[t\) j Vt. For convenience, we also set n mi [t] = Tt mi (cti[t\) making implicit 

the dependence on t and T. Note that the large-scale coefficient is typically only distance- 
dependent and independent of frequency allowing us to omit the index j when representing it. 
We assume that the base station has perfect knowledge of {ai[t]} and all distribution information 
{•7r m i[£]}. Most importantly, t represents the time-scale at which feedback optimizations and 
scheduling assignments are decided. 

Traffic model: Each user k E {1,2, . . . , K}, has a queue of untransmitted packets with 
queue-length q k [i\ that is maintained at the base station with associated arrival rate A*,. 

Feedback model: The base station allocates a feedback budget of b k [t] bits to user k such 
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that J2k=ibk[t] < B where B represents the total limited feedback budget of the system. Let 
the sub-carriers in our OFDMA system be indexed by S = {1,2, ... , L}. Assume that user k 
is allocated sub-bands ftf k [t\ ^ <S by the slow scheduling algorithm. Given a budget of b k [t\ bits 
by the base station and an assignment J\f k [t\ of size |A/fc[t]| = n k , the user employs a codebook 
of size b kj [t\, j E Af k [t\ bits for sub-band j where J2jeAf k b *>M = b k[t\; {hj[t\}jeM k represents 
the per-sub-band budgets for user k that are chosen by the user to maximize rate. 

Quantized channel state: Given a budget of b k [t\ and a sub-band assignment A/fc[£], the 
actual post-quantization rate achieved by user k at time t where i < t < t + 1, on sub-band 
j E Afk[t\ is denoted by ^ 9 k j[bkj[t\, A%-[t]]. Note that the actual achievable rate is determined by 
the quantization budgets (along with the codebook of course), that are decided on the slower 
time-scale indexed by i, as well as the true state of the channel at current time t. 

Network state: The network state at time i is given by M[t\ = ({7r mi p]}|£i, {qk[i\}iLi), 
which is a collection of channel distributions and queue lengths on the slower time-scale. In 
general, the feedback allocation and slow scheduling policies make allocation and assignment 
decisions, respectively, for T time slots i < t < t + 1 based on state M[t\. 

Expected rates and virtual users: Let r fe j[a fc [f|, bhj[t\] = E^i] [a*^- [^fej [*] , /%[*]]] denote the 
expected rate (through the course of T time slots) for user k on sub-band j. The total expected 
rate that is achieved by user k given a sub-band assignment Afk[t\ and allocation b k [t\ is then 
given by J2jeM k [t\ r kj[®k[t\, b k j[t\]- We make an observation at this point that helps us simplify 
the presentation of the results. Since the rate is additive across sub-bands, and is a function of 
a band-independent channel gain, one may consider and analyze an equivalent virtual system 
where the number of users is equal to the number of sub-bands. This removes the dependence of 
the feedback allocation policy on the assignments A4p]- In other words, the equivalent system 
would consist of L users assigned to L sub-bands with feedback allocations {6j/[t]}^ =1 and rates 
rj/[a!j/[f], As for the queue lengths, one can simply "replicate" the same queue length q k [t\ 
for all virtual users k' E A4p], i-e-, Qk'[t] = Qk[t\, VA/ E J\f k [t\. Once the optimal feedback 
allocation {&*/[t]}jv =1 and virtual rates are computed, we can map back to the original 

system by calculating the true rate for user k as Yli'eAf k [t\ r i'[ a i'\j]ib*,$\]. 

Through the remainder of this paper barring the final simulations section, we study the 
equivalent system mentioned above where we have L users assigned to L sub-bands. Having 
defined all the ingredients of our OFDMA downlink network, we move on to the next section 
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where we develop the feedback allocation policy that periodically makes decisions based on the 
network state. 

III. Throughput-optimal feedback allocation with slow scheduling 

In this section, we develop a feedback allocation (codebook size adaptation) protocol that 
when operated in conjunction with a given slow data scheduling policy, guarantees throughput- 
optimality. This means that given an arrival rate vector A, if there exists any scheduling policy 
that can guarantee bounded expected queue sizes, then so can the proposed policy, which falls 
under the Max Weight family of policies that was pioneered by Tassiulus and Ephremedis ll29l . 

As mentioned towards the end of the last section, we now have a virtual system with L users 
assigned to L sub-bands with feedback allocations }£/ = i, rates {tv [«/[£], }fe'=i and 

queues {q k '[t\} k > = i- Through the remainder of this paper, until Section [VH we replace the index 
k' by k for convenience, with the implicit understanding that we are dealing with virtual users. 
The feedback allocation policy is presented below. 



Algorithm 1 Max Weight feedback allocation with slow data scheduling 



1: 


while t > do 






2: 


if t (mod T) = then 






3: 


Set i = t 






4: 


Solve 








{Km = 


arg max J2 k =i Qk [t\r k [a k [t\ , b k ] 








w.r.t. b k e {0,1,..., B}, V/c 


(1) 






s-t- ELi h < B. 




5: 


end if 






6: 


end while 







A few remarks about the above algorithm are in order: 
(i) Throughput-optimality: The algorithm is throughput-optimal with respect to the space of 
policies that make feedback allocation and assignment decisions once every T slots. This means 
that if any policy that makes feedback allocation and assignment decisions once every T slots 
can stabilize a set of arrival rates {X k }, then so can the proposed policy in (OQ). Let the region of 
rates that can be stabilized by the policy in (OQ) be denoted by V. The above notion of throughput 
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optimality for queueing systems has been used extensively in the literature (see Il24ll . Il25l , l|29ll , 
ll30l and references therein). We do not prove throughput-optimality as it follows from standard 
Lyapunov techniques that are well-established in the queueing literature ||30ll . 
(ii) Computational complexity: While the optimization problem characterizes optimal perfor- 
mance, solving it exactly may be computationally prohibitive. In fact, a brute-force approach to 
solving (OQ) would incur a complexity of O ((^f^ 1 )). 

The final remark forms the basis for the remainder of this paper. The brute-force approach 
to solving (OQ) is clearly infeasible from an implementation perspective. We take up the issue of 
complexity starting in Section [IV] and propose a host of computationally-efficient algorithms 
to solve the feedback allocation problem in (OQ). We wish to highlight that all algorithmic 
developments can be applied to full-buffer (saturated) systems where scheduling schemes such 
as proportional fairness become applicable. This is because most schedulers of interest solve a 
weighted sum-rate maximization problem at each instant OTl . 

IV. Optimal feedback allocation through dynamic programming 

In Section Unl we have established that for queue stability, we are interested in solving the 
following online weighted sum-rate maximization problem 

m&x {bk}€B J2k=i Qk[i\r k [a k [t\, b k ]. (2) 

The form of the functions {rfc[ttfc[t], fefc]} would of course depend on the underlying physical 
system and is intimately connected to the computational complexity of the problem. In fact, for 
complex modulation/coding schemes the function might only be available as a look-up table. 
While the optimization problem characterizes optimal performance, solving it exactly may be 
computationally prohibitive. Thus, the focus of this paper becomes algorithmic. We propose 
novel solutions to © through Sections [IV] and |V] that explore the natural tradeoffs between 
accuracy, complexity and the structure of the weighted sum-rate function. We start by showing 
that by using Dynamic Programming, the exact solution can be obtained in pseudo-polynomial 
time. 

Theorem 1. The online resource allocation problem (|2|) can be solved exactly in time O (LB 2 ). 
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Proof: Order the users arbitrarily. We choose to work with the existing order w.l.o.g. For any 
given arbitrary weights {u>j}, Wi > 0, define A(i,j) — Wir k [ai,j] to be the weighted rate for user 
i given we allocate j bits to this user and define R(k, b) — max^i- 6 . <6 fe . gNo Yli=i w i r i[ a ii h] 
to be the maximum weighted sum-rate if we have b bits to allocate amongst the first k users with 
i?(0 ; b) = 0. It follows that R(l, b) = A(l, b), b = 0, . . . , B. We can write a recursion R(k, b) = 
maxj =0j b {R(k — 1, b — j) + A(k,j)}. The optimality of this recursion can be established using 
standard induction arguments similar to the two-dimensional knapsack problem IfToll . This rule 
gives rise to a table with a total of L(b + 1) elements. In order to compute element (k, b) in the 
table, using our recursion, we incur a complexity of 0(b + 1). Hence, the total complexity can 
be calculated as £Li £f =0 (& + 1) = L £f =0 (fc + 1) = L (B+1) f +2) = 0(LB 2 ). ■ 

Thus, we have proposed an exact solution using dynamic programming, which has pseudo- 
polynomiaj^ complexity O (LB 2 ) and which is applicable to any type of weighted sum-rate 
function. Therefore, in contrast to the joint power-control and scheduling problems in ll26ll - ll28Tl 
and owing to the discrete nature of the feedback allocation problem we consider in ©, we 
do not require any special channel-induced properties of the objective function such as those 
imposed on its partial derivatives in Lemma 2 of E71 . in order to find an optimal solution. 

Note that R(K, B) in Theorem Q] with Wi = qi, Vi, is equal to © and dynamic programming 
essentially gives us a technique to compute R(K, B) by solving smaller sub-problems. The 
following toy example with K = 2 users and a total bit budget of B = 2 bits illustrates a typical 
series of computations en route to calculating i?(2,2). 

Example (Dynamic programming): Order the two users arbitrarily, say user 1 first followed 
by user 2. Then, initialize the following weighted rates appropriately for b — 0, 1, 2, 

R(l, b) = A(l, b) : when user 1 is allocated b bits 
R(2, b) = A(2, b) : when user 2 is allocated b bits. 

Once initialized, we then compute value R(2, 1) = max{ J R(l, 1) + A(2, 0), R(l, 0) + A(2, 1)} = 

2 An algorithm has pseudo-polynomial complexity if its running time is a polynomial in the size of the input in unary. The 
size of the input to (O in unary at most LBA m nx + B — O(LB) where A max — maX(jj) A(i,j). 
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max{i?(l, 1), A(2, 1)}. Finally, we calculate 

#(2,2) = max{#(l,2) + A(2,0),#(l,l)+A(2,l), 
fl(l,0) + A(2,2} 
= max{A(l, 2), R(l, 1) + A(2, 1), A(2, 2)}, 
the desired optimal weighted sum-rate with two users and two bits. 

To understand the computational requirements in the context of a real-world system, consider 
the LTE example that was presented in the introduction to this paper. Here, we had the following 
parameters: L = 50, K = 50 with 4-bit modulation/coding tables at the mobiles. To model 
the limited feedback constraint, let B = AcL, c £ {1,2,..., A' — 1}, which has an intuitive 
interpretation of being able to provide full feedback to at most c users; c = A represents 
no constraint on feedback resources for this setting. Then, a feedback bandwidth of c = ^ 
corresponds to a complexity of roughly 7 x 10 11 operations, which is clearly quite daunting. 
Thus, while the dynamic programming approach is indeed viable for sufficiently small systems, 
we require algorithms with faster running times that might be less accurate. This forms the focus 
of the remainder of this paper. 

V. Reduced-complexity resource allocation 

In this section, we show that if the weighted sum-rate functions have additional structure, we 
can develop faster algorithms. As is often done for computationally hard problems, one seeks 
efficient but potentially sub-optimal algorithms, but then proves lower bounds on the performance. 
In this vein, we develop more computationally efficient algorithms that approximately solve ©, 
and provide theoretical lower bounds on their performance. The long-term performance of these 
approximate algorithms in achieving queue stability is characterized by Theorem |2] below. The 
proof is omitted as these are well-known results in queuing systems. 

We say that an algorithm is a 7-approximation, 7 £ (0, 1], to ® if it provides a solution {bf 9 } 
such that Y.k^kWkWk^-.b ^ 9 } > jmax{ bk } eI3 Y, k Qk[t\r k [a k [t\, b k ). The following theorem is a 
generalization of the original result by Tassiulus and Ephremedis [|29l . It essentially states that 
local approximation is consistent with the long-term objectives we consider. 

Theorem 2. If X £ {71/ : v £ V},7 £ (0,1], then a ^-approximation to the per-instant 
scheduling rule {b*[t}} = argmax^jge qk[t\rk[ak[t\, b k ] stabilizes the system. 
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Recall from remark ( i) in Section [III] that V represents the region of rates that are stabilizable 
by Algorithm [Q The theorem essentially states that for queueing systems: If we calculate a 
7-approximate solution to © in every time slot, one can achieve a 7-fraction of the throughput 
region. This result paves the way for the design of computationally-efficient algorithms, by 
constructing approximations to ©. 

In Section \M we consider weighted sum-rate functions that are non-decreasing and sub- 
modular in the feedback bit allocation. In short, sub-modularity refers to diminishing returns 
with respect to the allocation of resources. This is a property that is exhibited quite frequently 
by wireless systems in general, e.g., point-to-point capacity scales logarithmically in transmit 
power, achievable rates in multiple antenna precoding systems exhibit diminishing returns in the 
size of the codebook ifTTl . lfT8l . etc. In the developments that follow, we exploit this property in 
order to propose a greedy feedback allocation algorithm that has complexity 0((B + L)\og 2 L) 
with approximation factor of (l — ~). Our main contributions are contained in Lemma [2] and 
Theorem [3j 

In Section [Bj we focus on a class of weighted sum-rate functions that arise in downlink 
scenarios where the base station is equipped with multiple antennas and performs transmit 
beamforming with quantized beamformer feedback. This is a popular transmission strategy that 
been extensively researched IfTTl . Il33l - ll35l and adopted into standards such as W-CDMA 11321 
and LTE [1J. We show that for this choice of physical layer scheme, the weighted sum-rate 
maximization problem in © is sub-modular for certain types of beamformer quantizers. We 
illustrate the improvement in computational performance by using the LTE example from the 
introduction. 

A. Reduced-complexity resource allocation through sub-modularity 

We begin this section with a quick primer on sub-modular optimization (summarized from 
EH-ETJ) that will be useful for our purposes. In keeping with the literature, the approach 
pursued in this section is graph theoretic in contrast to the rest of this paper. A sub-modular 
function is defined as follows: Let E be a finite set and 2 E represent all its subsets. Then, 
F : 2 E — > IR + is a non-decreasing, normalized, sub-modular function if F(0) = (normalized), 
F(A) < F(B) when A C B C E (non-decreasing) and if F(A U {e}) - F(A) > F(B U {e}) - 
F(B), WA C B C E and e G E \ B (sub-modular). 
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The following property of sub-modular functions is useful for our analysis. 

Lemma 1. If F n (-), n = 1, . . . , N, are sub-modular on set E, then Yl!l=i w nF n (A), A C E is 
a sub-modular function for w n > 0, Vn. 

Having provided the definition of sub-modularity along with a useful property, we now 
introduce the kinds of constraint sets that are typically considered in the context of sub-modular 
optimization: (i) A set system (E,X) where E is a finite set and X is a collection of subsets of 
E is called an independence system if G X and satisfies if A C B for B E X, then A E X. (ii) 
An independence system is called a matriod if it satisfies the following additional property; if 
A,B E X and \A\ < \B\, then there exists e E B \ A such that A U {e} E X. (iii) Set X is a 
uniform matroid if X = {F ^ E : \F\ < k} for k E N. 

The optimization problem that has been considered in the context of sub-modular functions 
and independence systems is 

F* = max F(A). (3) 

AeI,ACE y ' 

Since many NP-hard problems can be reduced to a sub-modular function maximization over 
an independence system, significant research has focused on developing efficient approximation 
algorithms. In particular, the performance of the greedy algorithm in solving special cases of 
© has been extensively studied. Nemhauser et al. |[22| considered problem © over uniform 
matroids and showed that the greedy algorithm provides a (1 — -) approximation factor for this 
special case. Please refer to Goundan et al. |fT9l , Calinescu et al. f20]] and Vondrak [12111 for a 
summary of related results on sub-modular function optimization over other families of constraint 
sets. The greedy algorithm is presented later in the section in the context of our specific feedback 
allocation problem. 

Sub-modularity in feedback allocation: We now show that the optimal bit allocation problem 
in (0 may by posed as a sub-modular maximization over a uniform matroid when the rates 
exhibit sub-modularity. Let Q — (U, V, E) be a bipartite graph where U contains L user nodes 
and V contains B bit nodes, both ordered arbitrarily, i.e., \U\ = L and \V\ = B. Let E 
contain the set of all edges E = {e^ : i = 1, . . . , L and j = 1, . . . , B}. Given A C E, we 
define \A\i — \{e kb E A : k = i}\ to represent the number of bits allocated to user i, i.e., 
\A\i = bi. The independence system we are interested in is X = {A C E : \A\ < B} where 
B is the total bit budget. By definition, X is a uniform matroid and furthermore, X is the set 
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of all valid allocations since if A el, then b k = ELi l^lfc < B and if A <t x ' then 

Y^k=i b k — J2k=i \A\k — \A\ > B. Now the weighted sum-rate maximization problem in © in 
time slot t may be re- written as 

max {bfc}gB Ylk=i^ r k[ a k%h\ 
= max J2t=i ?fe r fe l a k [t\ , h] ~ r k [a k [t\ , 0] 

s.t. h = \A\ k , E k \ A \k<B, ACE 

= maxAei J2k=i Qkrk[a k [t\, \A\ k ] - r k [a k [t\,0]. 
The following result becomes immediate. 

Lemma 2. If the function r k [a k , b k ] is non-decreasing and sub-modular in the bit allocation b k = 
\A\ k , A C E for all users k = 1, . . . , L, and channel states a k e Q, then Yl k =i Qk r k[ a kj \ A \k] ~ 
rfc[afc,0] is a normalized, non-decreasing, sub-modular function on set E for all channel states 
{a k } G Omega L . 

Proof: The result follows from Lemma [Q ■ 
Hence, the greedy algorithm can be used to solve the optimal bit allocation problem in © with 
approximation factor (l — -Y The greedy algorithm for the specific case of our bit allocation 
problem in time slot t can be written as follows where u k (b k ) — q k (r k [a k , b k + 1] — r k [a k , b k ]) 
denote the increase in rate or marginal utility if user k is given one extra bit. 

Algorithm 2 Greedy feedback allocation 
l: Set b k = 0,\/k, which is essentially a bit counter for each user 

2: Compute marginal utilities {u k {b k )}. 

3: while J2k < B do 

4: Sort this list of marginal utilities. 

5: Assign a bit to user k* who is on top of this list. 

6: Update b k * = b k * + 1 and re-compute u k * (b k * ) 

7: end while 



We end this section by investigating the complexity of the above algorithm in the following 
theorem. 
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Theorem 3. The greedy algorithm approximates the optimal bit allocation problem in ((2]) to 
within a factor of (l — ^) while incurring complexity 0((B + L)log 2 L). 

Proof: Step 2 of this algorithm incurs complexity 0(L\og 2 L) for the first iteration 5=1. 
Subsequently, every re-sort in Step 3 costs 0(\o% 2 L) with a maximum of B such re-sorts. Thus, 
the total complexity is 0((B + L)log 2 L). For the proof of the approximation factor, please refer 
to Nemhauser et al. ||22ll . ■ 
In the context of the LTE example introduced earlier, this means that by exploiting the sub- 
modular structure in the rates, we reduce the complexity from 7 x 10 11 to 15 x 10 3 operations. 
Before we move on to the next section, we provide an example of a common wireless setting 
where sub-modularity is exhibited. Consider a traditional point-to-point single antenna wire- 
less link with a 6-bit modulation-coding table at the receiver. The modulation-coding table is 
constructed as follows. Given a non-negative real number in the interval [0,a], a » 0, we 
uniformly partition the interval into 2 b sub-intervals and implement the quantization scheme 
l x \o = — x < + -0«§o * = 0, 1, . . . , 2 6 — 1. Then, for any fixed position-dependent 

gain of a, the achievable rate of the system in a fading environment can be written as 

r[a,b] = E,[log 2 (l + [v^|/f J Q )], (4) 

where \h\ 2 is a truncated exp(l) random variable that has a maximum value of a >> 0. The 
probability density function for such a random variable is given by /^(x) = C(cr) exp(— x) 
where C(-) is a normalization factor. Note that this example considers a traditional continuous 
fading model. One may obtain its discrete version thereby conforming with our system model, by 
sampling the support [0, a). Thus, the rate expression in © may be treated as an approximation 
that becomes increasingly accurate as we discretize the support more finely. For the case a — 1, 
the rate © can be explicitly computed as 

r[l,b] - C(a)zt-hog 2 (l + %)f^ 1)1s eM-x)dx 

= [1 - exp (-£)] Eto 1 1°S2 (1 + f ) exp (-<£) . 

Setting l[j,b] = log 2 (l + |£), the normalized incremental gain with one extra bit can be 
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calculated as 



Cr(cr)- 1 (r[l,6+l]-r[l > 6]) 

1 a 

1 - e 2 2b 



E-=o -1 i[i,6+l]e- 



1 — e 2^ 



ELo^MK 

1 tT 

1 - e 2 26 
6 + l] e -(2i+i) 



ELo i[2j, & + l]e^* + ELo l W + !. 



2^ 



(5) 



1 - e F 



ELo^M]^ 



by splitting odd and even terms 



E ^o 1 e" J '* log 2 ( 1 + J 



-+.; 



Through simple numerical enumeration, one may confirm that the 1-bit rate gain given above 
in (0) decreases over realistic bit sizes of 6 € {1,2,..., 25} and hence, r[l,b] is a sub-modular 
function. With a little more algebra, one may derive a similar result for the general case with 
any arbitrary, non-negative, position-dependent gain a. 

In the next section, we provide another example of a wireless system that exhibits sub- 
modularity. In particular, we consider a class of multiple antenna wireless links and solve © in 
the context of these systems. 



B. Reduced-complexity resource allocation for MISO systems 

When the user rates rk[a, b] are sub-modular in the bit allocation b in every channel state 
a G fl, we use the greedy algorithm in Section |A] to approximately solve the online feedback 
allocation problem in © with complexity 0((B + L)log 2 L). In this section, we show that 2x1 
MISO quantized transmit diversity systems exhibit sub-modular expected rates bringing into use 
the results from the previous section. Furthermore, in the context of these specific transmission 
schemes, we develop an approximation algorithm based on convex relaxations with a further- 
reduced complexity of 0(L\og 2 L) and an approximation guarantee of | for typical operational 
signal-to-noise ratios (SNR). Thus, aside from the usual impact on precision that is typically 
omitted from running time calculations, the running time of our algorithm no longer depends 
on the feedback budget B. In the example above, the running time is reduced even further from 
15 x 10 3 operations to roughly 300 operations. 

We begin this section by investigating the effects of limited feedback on the aforementioned 
class of MISO systems. It is well-known that the instantaneous SNR for a classical 2x1 
single-stream beamforming MISO link is given by SNR(a)||h|| 2 where SNR(ct) = jf, P is the 
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transmit power, N a is the noise power and h = [hi /i 2 ] T \ hi E C represents the MISO channel 
with zero mean, unit variance complex Gaussian entries. As with the example in the previous 
section, the analytical rate expressions in this section are derived for continuous vector channels, 
which are increasingly accurate approximations as we sample the support C 2 more finely. Recall 
from Section |n] that a E Q, models the effects of large-scale fading. To achieve this maximum 
instantaneous SNR, the user requires perfect feedback of the channel vector h. However, feedback 
in realistic systems is imperfect due to limited feedback budgets and quantization, the primary 
motivation for this work. We assume that the channel vector h is quantized using the popular 
Random Vector Quantization (RVQ) technique IfTTl . 11341 . This technique is briefly reviewed in the 
next section when we present simulation results. Recent results 1(171 . 11331 . Il34l bound (upper and 
lower) the loss in rate due to quantization of h when using RVQ codebooks. In particular, both 
upper and lower bounds on the rate loss due to quantization for user k take the form c(a k )2~ bk 
for some c(aifc) > 0. Motivated by these results, we assume that the post-quantization rate for user 
k in the presence of large-scale fading takes the form r k [a k ,b k ] = E [log 2 (l + SNR fe | |h| | 2 )] — 
(E [log 2 (l + SNR fe ||h|| 2 )] - E [log 2 (l + SNR fc |/i| 2 )]) T h \ where we have omitted the depen- 
dence on i for brevity. We validate the use of the above approximation through numerical testing 
in the next section for many values of a k from a typical operational range in a wireless system. 
Thus, the optimization in © for the 2x1 MISO case takes the specific form 

max {MeB ££ =1 q k [/3 2 (SNR fc )- (/3 2 (SNR fe ) - /3i(SNR fc )) 2~ bfc ] , (6) 

where SNR fc = SNR(a fc ) for short, ft (SNR) = E [log 2 (l + SNR>i| 2 )] and 

/3 2 (SNR) = E [log 2 (l + SNR||h|| 2 )] 

denote the one-tap and two-tap expected rates, respectively, for a Rayleigh fading channel with 
the given SNR. 



Relaxation and approximation guarantees: Through the remainder of the section, we de- 
velop an approximation algorithm to solve © in closed-form while incurring a complexity of 
C(Llog 2 L]a We provide an approximation guarantee of ~. 



3 We recognize that there is an additional storage cost of C(log B). 
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Theorem 4. Consider the following continuous relaxation of (H|) formed by replacing the discrete 
set B with its natural continuous extension and dropping terms that are independent of the 
variables {b k }: 

L 

{b* k } = arg min V q k ^(SNR k )2- b K (7) 
J2 k b k <B, b fe eM + f-f 
k=i 



The solution to this relaxation is b* k = 
that J2k K = B and [x] + = maxjx, 0}. 



log 2 



Ik (log 2) j 3 1 (SNR k 



, where rf is chosen such 



Proof: See Appendix lAl ■ 
Next, we comment on the complexity of computing the above fractional solution. 

Theorem 5. Computing the above solution in Theorem® incurs a complexity of 0(Llog 2 L). 

Proof: See Appendix lAl ■ 
The following lemma states that weighted sum-rate function in © is non-decreasing and sub- 
modular on set E = {e k b : i — 1, . . . , L and 6=1,..., B}, thereby allowing us to connect and 
compare the results in this section with those in the previous section on sub-modular functions. 
The proof is standard in the literature on sub-modular functions and follows from the fact that 
the fractional relaxation of the weighted sum-rate function is concave in {b k } over the domain 
{[0, B} K : E fe & fc < B}. It is hence omitted. 

Lemma 3. The weighted sum- rate function in © where b k = \A\ k , A C E, E = {e k b : % = 
1, . . . , L and b = 1, . . . , B} is non-decreasing and sub-modular on this set E. 

Comparing the results in Theorems [3] and [5l we see that by assuming less about the exact 
form of the communication system, we are incurring an added complexity cost of 0(B\og 2 L), 
while providing a system-independent approximation guarantee of (1 — -). 

Once we solve for b* k , we apply a floor operation in order to enforce the integer constraints, 
i.e., we set b* k INT = [b* k \ if 6£ > 1 and b k INT = if b* k < 1. This leads us to the task of 
quantifying loss due to integrality, which we do next. We consider two cases: For b k > 1, we 
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have that 



f3 2 (SNR k ){l-2- b k.lNT- )+l3l ( S NR k )2- b k,lNT 

fa (SNRfc) (1-2"^ )+/3i (SM k )2- b % 

> /3 2 (SNR fc )(l-2- 6 fc+ 1 )+/3 1 (SNR fc )2-''fc- 1 

- /3 2 (SNR fe )(l-2" !, fc)+/3i(SNR fc ) 

since^ - 1 < b* kJNT <bl + l (8) 

> 1 ^)^ since i<&*< oo 

- 2 /3i(SNR fc )2 b k - k 
1 

2" 



Similarly for b* k < 1 and b kjINT = 0, we have that 



/3 2 (SNR fe )(l-2 6 fe)+/3i(SNR fc )2 6 fc 



fe(SNR fc )(l-2~ i 'fc-rJvr)+/3i(SNR fc )2~ i 'fc.-f^T 

SNRfc)(l- 
i(SNR fc ) 

1 

1 fa(SNRfc) | i ' 

2 ( S 1 (SNR fe )" r 



^ suSk) since < 1 (9) 



From ([8]) and ©, we can compute the approximation factor as 



min < -, p 1 s > . 

2' 1 Trlov ffe(SNR fc )^ 



I niax fc 



ft(SNRfe) 



Thus, the approximation factor critically depends on the ratio M^^ fe j , which essentially repre- 
sents the rate gain due an extra tap or antenna. In Fig. [H we numerically compute ^ 2 |^^^| for a 




10 15 



Fig. 1. Rate gain due to the addition of an extra antenna as a function of SNR. 

typical cellular range of — 15dB to 15dB and see that ^fe4 < 2 over this range. Combining 

Pi( SNR fc ) 
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the results in Fig. Q] with (flOl) , we can conclude that the proposed relaxation/rounding algorithm 
has an approximation factor of |. 

In summary, the two proposed algorithms exploit the structure of the feedback allocation 
problem in settings such MISO with quantized beamforming, to deliver lower complexity than 
the optimal dynamic programming approach accompanied by guarantees on accuracy. Note that 
the accuracy guarantees, namely, (1 — -) for the greedy algorithm and | for the convex program 
are independent of any system parameters such as channel statistics, total bit budget B, etc., and 
are hence, a clear measure of worst-case performance. We now move on to numerical simulations 
in the next section, which helps us understand the actual performance against the backdrop of 
these worst-case guarantees. 

VI. Numerical Simulations 

In this section, we evaluate the performance of the greedy feedback allocation algorithm 
in a MISO downlink network. The simulations serve as a proof of concept for the proposed 
dynamic feedback allocation approach. As the baseline case, we introduce a static equal allocation 
algorithm that we describe in detail below along with the rest of the simulation setup. Note that 
we now revert back (from the virtual system with L users) to the original system with K users, 
i.e., the indices k = 1, 2, . . . , K, now track actual users. 

Number of users, OFDMA bands and data scheduling policy: There are K = 4 users in a 
10MHz system with a total of L = 8 OFDMA sub-bands. Since the focus of these simulations 
(and this paper) is primarily on quantifying the gains of dynamic feedback allocation, the users are 
assigned equal amounts of spectrum for data transmission at the beginning of the communication 
epoch that do not change with time, i.e., user % is always assigned to bands {2i — 1, 2z}. 

Small-scale fading, average user SNRs and traffic model: The users are stationary and 
have fixed average SNRs through the entire epoch of communication. We consider two av- 
erage SNR profiles - (i) Large asymmetry with average SNRs 101og 10 (SNRi[£j) = — lOdB, 
101og 10 (SNR 2 [t]) = -8dB, 101og 10 (SNR 3 [t]) = lOdB, 10 log 10 (SNR 4 [t] ) = lOdB and (ii) 
Nearly symmetric with average SNRs 101og 10 (SNRi[t]) = -ldB, 101og 10 (SNR 2 [t]) = -ldB, 
101og 10 (SNR 3 [fj) = ldB, 101og 10 (SNR 4 [t]) = ldB. Asymmetric profiles are of interest because 
this is the regime where dynamic allocation would arguably have most value. The small-scale 
fading channel realizations h in each slot are generated according to the standard complex 
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Gaussian distribution. The arrivals are assumed to be deterministic and symmetric with rates 

X k = A, Wk. 

Feedback budget and baseline equal allocation: The feedback budget is set to B = 12 bits. 
The baseline algorithm allocates an equal number of bits to each user, i.e., b k = 3, V/c. Each 
user in turn distributes these three bits as follows - two bits to the first sub-band it is assigned 
and one bit to the second. In other words, the per sub-band allocation for user k is b k \ = 2 and 
bk2 = 1- The allocation is changed every T = 10 slots. 

MISO RVQ codebooks and post- quantization rate: For each bit allocation b, we generate 
codebook C(b) by choosing two points uniformly at random from the sphere C 2 . For such a 
codebook C(b), we compute the ergodic rate over 1000 standard (zero mean, unit variance), 
complex Gaussian channel realizations. We repeat this experiment over 100 codebooks and 
choose the codebook C*(b) that provides maximum ergodic rate. We repeat this procedure for 
each be {0,1, ... ,B} and create a super-codebook {C*(0), . . . , C*(B)}. Note that the codebook 
generation procedure is done once at the beginning of the communication epoch. In the previous 
section, we proposed 

r k [a, b] = &(SNR)(1 - 2~ b ) + ft(SNR)2- ft (11) 

as an approximation for the ergodic rate given b bits. In Fig. [2l we compare (fTTI) with the true 
(numerically computed) ergodic rate given b bits at various SNR values in a typical operational 
range. We see that (fTT|) is indeed an accurate approximation. 



1.5r 4.5 




2 4 6 8 10 12 2 4 6 8 10 12 

Number of feedback bits Number of feedback bits 



(a) (b) 

Fig. 2. Comparison of predicted rate Jilt with true numerically computed ergodic rate given for codebooks {C*(&)}^_ at 
various values of SNR; (a) Low-to-moderate SNR (b) Moderate-to-high SNR. 



21 



Having described the simulation setup in detail, we now present the results of our experiments. 
We compare the performance of three algorithms - the greedy dynamic feedback allocation 
algorithm in Algorithm [2l the equal allocation case, and the case with perfect feedback (i.e., 
where the bit budget B = oo) - under the two average SNR profiles. The results for SNR 
profile with large asymmetry are plotted in Fig. [3l In Fig. |3(a)[ we see that the greedy dynamic 



a 6 
S 5 



— I — Static equal allocation 
■ $ - Dynamic greedy allocation 
Perfect Feedback 



t ' 8 * 8 



* «- *- 



Throughput X (kbps) 



14 .s4 




— I — Static equal allocation 
■ $ - Dynamic greedy allocation 
— H — Perfect Feedback 



#♦♦♦4 




1.5 2 2.5 

Throughput X (kbps) 



(a) (b) 
Fig. 3. Throughput under the two feedback schemes with different average SNR profiles. The average queue length is measured 
over 10000 iterations; (a) Large asymmetry with SNR profile { — 10, —8, 10, 10}dB (b) Nearly symmetric case with SNR profile 
{-l,-l,l,l}dB 



allocation outperforms the static equal allocation approach by almost 13% while consuming only 
an additional log2 (( D = q.88 bits per second of overhead. Furthermore, greedy dynamic 
algorithm achieves within 1.5% of the optimal allocation^ through dynamic programming thereby 
rendering the performance guarantee of (1 — -) in Theorem [3] quite conservative. 

In the nearly symmetric case however, the gains due to dynamic allocation decrease and almost 
vanish in the particular experiment that we consider in Fig |3(b)[ as would be expected. We see 
that in this case, the greedy algorithm achieves within 20% of the optimal. 

Thus, with minimal expenditure in overhead, the dynamic allocation approach achieves notable 
gains in throughput for asymmetric settings, thereby showing considerable promise for systems 
with larger feedback budgets and a greater degree of asymmetry (in traffic loads and channels). 



4 The optimal weighted sum-rate is at most as large as the weighted sum-rate with perfect feedback. 
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VII. Concluding remarks 

We summarize the algorithmic contributions presented in Sections [IV] and [V] in Table [D We 
observe from the table that these algorithms explore the tradeoffs between accuracy, computa- 
tional efficiency and the structure of the weighted sum-rate function. An interesting question and 
future direction pertaining to the section on MISO systems is whether such an analysis can be 
extended to cover other commonly-deployed multiple antenna architectures. Finally, the design 
of joint data scheduling and feedback allocation policies is another direction for future research. 

TABLE I 

Properties of proposed online feedback allocation algorithms 



Algorithm 


Required structure on 
weighted sum-rate 


Complexity 


Approx. 
factor 


Dynamic 
Programming 


None 


0(LB 2 ) 


1 


Greedy 


Non-decreasing 
Sub-modular 


0((B + L)\og 2 K) 




Convex 
Relaxation 


Non-decreasing 
Sub-modular 
MISO RVQ Systems 


0(L\og 2 L) 


1 

2 



In summary, we propose optimal feedback allocation policies for cellular downlink systems 
where the base station has a limited feedback budget. This problem is solved using dynamic 
programming incurring pseudo-polynomial complexity in the number of users and the total bit 
budget. When the weighted sum-rate is a non-decreasing sub-modular function, we leverage the 
theory of sub-modular function maximization to propose a greedy algorithm with polynomial 
complexity that has a approximation guarantee of (l — j). For MISO transmit beamforming 
physical layer communication schemes with quantized beamformer feedback, we recognize that 
the weighted sum-rate function is non-decreasing and sub-modular for RVQ codebooks. More 
importantly, it takes a special form that allows us to develop an approximation algorithm based 
on convex relaxations that can be solved in closed-form, incurring lesser complexity than the 
greedy algorithm. We connect the performance of the proposed approximate online algorithms 
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to the long-term throughput region of the system. 
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Appendix A 
Proof of Theorems SHU 

Proof of Theorem® The objective function is clearly convex since 2~ bk is convex and since linear 



k 



sums preserve convexity. By studying © closely, we can also say that b* k is such that J2k=i b 
B since if this not true, we can increase the bit allocation for at least one user thereby decreasing 
the objective function. Since B > 0, b k = 0, VA; is in the interior of our constraint set B, which im- 
plies that Slater's constraint for strong duality is satisfied and that the Karush-Kuhn-Tucker (KKT) 
conditions are sufficient in nature. The Lagrangian cost function can be written as C(b k , ^k,v) = 
-Efe=i9fc r i( SNR fc) 2 ~ 6fc - x kh + v(T,k b k - B ) for which the KKT conditions are b* k > 0, 
K > 0, b* k X k = 0, and rf = q k r 1 (SNR k ) (log 2)2~ bk + X* k . Since 2~ b is a decreasing function in 
b, it follows that if 77* < g fc n(SNR fc )(log 2), then A*. = and b* k = - log 2 ( ^g 2)ri(s ^ fc) ) is 
a valid solution to ©. If rj* > g fc ri(SNR fc )(log 2), \* k = v * - ?fc ri(SNR fc )(log 2) and b* k = 0. 



Hence, we can write the solution as b* k 
that £ fe b* k = B. 



log 2 



q k (log 2)n(SNR fc ) 



where i]* is chosen such 



Proof of Theorem \5\ In order to compute the solution in Theorem IH we first need to sort 
{6 k } k=1 in ascending order where 6 k = g fc r!(SNR fc )(log 2). This has complexity 0{L\og 2 L). 
Call this sorted set {9 m }- Once sorted, we need to set rf = 9 m for each m and test feasibility. 
Testing feasibility incurs O (L), as it is a L-term addition and scanning through each 9 m incurs 
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0{\og 2 L) through the use of binary search. As we increase rj*, more b* m terms are set to zero. 
Once we locate mi and m 2 such that rj* = 9 mi is infeasible while r]* = 6 m2 is feasible, we 
can compute rj* in closed-form since it satisfies ^ m>m2 b* m = B. Hence, the total complexity is 
0(L\og 2 L) + 0(L\og 2 L) = 0(L\og 2 L). 



